CA-CMT: Coordinate Attention for Optimizing CMT Networks

نویسندگان

چکیده

Vision Transformer (ViT) has been proposed as a new image recognition method in the field of computer vision. ViT applies structure with excellent performance natural language processing to recognize images. Unlike existing Convolutional Neural Network (CNN) models, can achieve State-Of-The-Art (SOTA) without inputting Inductive Biases into model, demonstrating that is useful However, requires large datasets such ImageNet-21K and Joint Foto Tree (JFT) for learning. In addition, it takes lot time train. Moreover, there problem location information lost by images patch units. To improve issues, many models are being proposed. this paper, model restructuring neural networks Meet vision Transformers (CMT) applying Coordinate Attention Block, CNN problems family models. The combines Transformer, which shown Long Range, CNN, Local Feature, higher than We also compared those relatively small Canadian Institute For Advanced Research-10 (CIFAR-10), Self-Taught Learning-10 (STL-10), Tiny-ImageNet facilitate researchers’ access evaluation. Despite restructured from smallest CMT-Tiny showed better accuracy CMT-Tiny, CMT-XS, CMT-S, CMT-B CIFAR-10, STL-10, datasets. an 90.21% CIFAR-10 dataset, CMT except CMT-S 90.6%. It had lowest loss value 0.3967. expected be utilized backbone Object Detection Segmentation fields future.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Diophantine Equations CMT : 2011 - 2012

Solution 1.1.1. The prime factorization of 720 is 2 · 3 · 5. If we look only at the prime factors of x, y, z, we see that the exponents of 2 in the factorizations of x, y, z must sum to 4, the exponents of 3 must sum to 2, and the exponents of 5 must sum to 0. The number of possible triples (a, b, c) that correspond to the exponents of 2 in the prime factorizations of x, y, z is simply the numb...

متن کامل

MT mediaLibTM for Chip MultiThreaded (CMT) Processors

Innovation in processor design tends to happen in waves. The introduction of the first 4-bit/8-bit microprocessor designs (the 4004/8008) by Intel in 1971/1972 triggered a wave of competing designs from other semiconductor companies, including Motorola, Zilog, MOS Technology, TI, Rockwell, RCA, Fairchild, and others. The SPARC® architecture was part of a wave of RISC processor designs that appe...

متن کامل

Disorder Analytic Model-Based CMT Algorithms in Vehicular Sensor Networks

Recently, vehicular sensor networks (VSNs) have emerged as a new intelligent transport networking paradigm in the Internet of Things. By sensing, collecting and delivering traffic-related information, VSNs can significantly improve both driving experience and traffic flow control, especially in constrained urban environments. Latest technological advances enable vehicular devices to be equipped...

متن کامل

View-Oriented Parallel Programming on CMT processors

View-Oriented Parallel Programming (VOPP) is a novel parallel programming model which uses views for communication between multiple processes. With the introduction of views, mutual exclusion and shared data access are bundled together, which offers both convenience and high performance to parallel programming. This paper presents the performance results of VOPP on Chip-Multithreading processor...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2023

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2023.3297206